1 link tagged with all of: rag + context window + mit csail + recursive language models + rlm
Links
@Oliviacoder1 on X
Three MIT CSAIL researchers (Zhang, Kraska, Khattab) propose Recursive Language Models, which store a long document as a variable outside the model's context and have it search and read only the relevant parts, spawning sub-models to handle sections in parallel. The post claims this handles inputs about 100 times larger than a model's native window with better accuracy at similar cost, and the code is open source on GitHub.
- Standard frontier models score near zero on the hardest long-context reasoning benchmarks, and GPT-5 couldn't solve even 10% of problems requiring tracking code history beyond 75,000 tokens.
- RLMs keep the full document intact and queryable instead of summarizing or chunking it, and reportedly handle inputs up to 10 million tokens with double-digit gains over alternatives.
- The cost per query is reported as comparable to or cheaper than large-context calls, and the code is free on GitHub as a drop-in replacement for existing LLM API calls.
recursive language models
rlm
mit csail
context window
rag